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Appendix II 




STATISTICAL GUARDBAND METHODOLOGY 



5 Field of the Invention 

This invention relates to methods and systems used to develop guardbands for assessing 
product specifications. More particularly it relates to methods and systems for developing 
guardbands for integrated circuits such as processors which are subject to manufacturing, testing 
10 and environmental performance variations. 



Background of the Invention 



Guardbands are typically used in manufacturing to protect against product and process 
15 specification variations. However, if a manufacturer is too conservative in setting the guardband 
the amount of good products that fail testing is increased. If the guardband is too narrow, the 
products that go to customers may not function as specified. Two articles that discuss 
guardbands and the tradeoffs due to guardband placement are The Economics of Guardband 
Placement, Richard Williams and Charles Hawkins, International Test Conference 1993 and The 
20 Effect of Guardbands on Errors in Production Testing, Richard Williams and Charles Hawkins, 
International Test Conference 1993. 

Products, especially, integrated circuits, are designed to be used in a number of 
applications. Each application often provides a somewhat different set of operating conditions. 
To insure that the product can work in each of these applications manufacturing tests must be 
25 created to test both for these operating components and the surrounding impact of system 
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components. This could involve a number of variables and parameters. One of the most 
important variables for processors is the speed which the processor operates in its system 
environment. Semiconductor manufacturers are constantly changing their designs, application 
conditions and processes to get faster processors. 
5 Guardbands are determined today in a variety of ways. The easiest approach in 

developing guardbands is to develop tests that provide for the worst case of every variable. 
Other approaches include incorporating one of the variables mentioned above (usually test 
related variables) into determining a guardband, guardbanding reliability wear out mechanisms 
only, choosing a guardband to satisfy yield targets or not using a guardband at all. For many 
10 products, especially integrated circuits that are processors, establishing a guardband using these 
approaches can lead to sub optimal results. 



Summary of the Invention 

15 

Current approaches of setting the same guardband across speed sorts, guardbanding to 
worst case application conditions, and ignoring other variables, ends up lowering yields, 
providing fewer high frequency integrated circuits, and more lower frequency circuits. It is an 
20 object of this invention to provide a method of establishing a product specification guardband 
that treats variables statistically and allows risk level to dictate the appropriate guardbands. 

This invention is a method and system for determining product specification guardbands 
that first develops models of each variable that influences the product specification, such as: test 
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environment, the test environment to system environment differences, system environment and 
reliability by incorporating these variables into a statistical representation of each. The models 
are then input into a statistical program which performs a Monte Carlo analysis or analytical 
analysis (by convolving statistical distributions) to determine the correct specification 
5 guardbands. 

Brief Description of the Drawings 

10 

FIG. 1 is a performance-distribution plot of an integrated circuit. 
FIG. 2 is an example of the output which the guardband determination. 
FIG. 3 is a flowchart illustrating the process for obtaining the model for the system 
environment. 

15 FIG. 4 is a flowchart illustrating how the system to tester offset is generated. 

FIG. 5 is a graph illustrating the distribution of various sample sizes. 
FIG. 6 is a graph illustrating the fail rates due to reliability effects. 
FIG. 7 is a flowchart illustrating the steps for determining a product guardband according 
to this invention. 

20 FIG. 8 is a diagram that illustrates the typical hardware system used in determining the 

guardband. 
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Description of Preferred Embodiment(s) 

Determining final product specification guardbands are often the least considered items 
5 of product development. Yet the guardbands chosen can, and often do, have a major effect on 
product quality, revenue and yield. This is especially true when "deep sorts" exist. See the upper 
tail of the product performance-distribution plot of FIG 1 . Many factors compound the deep sort 
guardband complexity, and guardband choice may eliminate sort based on small area at tail 2 of 
the distribution. A slight change in guardband can affect a large portion of parts due to large area 

10 under performance distribution curve of FIG. 1. Yet customers desire the highest performing 
parts. Slower performing parts are usually less susceptible to reliability mechanisms. 

This invention incorporates market sector tolerance targets ( quality and reliability) and 
models representing key variables that affect the product in the target market sector. It then uses 
these factors to produce a final product specification guardband using a Monte Carlo analysis. 

15 For the described embodiment, these variables are: tester environment, system environment, 
system-to-tester offset and reliability wearout mechanisms. Each statistical model will first be 
described followed by the description of the overall method and system. 

Product performance or maximum frequency (FMAX) will be used to describe the invention 
because it is a critical specification in described embodiment which is built around the testing of 

20 integrated circuits, particularly processors. However it should be obvious to those skilled in the 
art that this methodology could be applied to other product specification such as but not limited 
to: the minimum / maximum operating voltage of a product, the minimum / maximum operating 
temperature of a product, minimum / maximum operating power of a product, minimum / 
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maximum sleep mode power of a product, access time for memory products, or any key product 
specification. 

For processors, FMAX, the maximum frequency that the integrated circuit will operate in the 
system environment, is important in terms of the application and price at which the processor 
5 will be sold. As a result of process variation, each processor has a different FMAX. Measuring 
FMAX and sorting a processor by performance is accomplished by running a set of functional 
test patterns at the desired sort frequencies. A processor is binned at the highest sort frequency in 
which all patterns function. Generally, the FMAX of the processor as measured on a tester is 
faster than the FMAX of the processor as measured in a system. 

10 The tester environment is one input to the guardband model. Tester characterization 

involves quantifying those variables that may contribute to inaccuracies in a product specification 
(i.e. FMAX) measurement on a tester. These include contributions such as: tester timing 
accuracy, clock edge placement accuracy, power supply distribution, temperature distribution and 
tester-to-tester offset. The error in FMAX can be broken up into two components, one 

15 mechanical and one electrical. The mechanical component contains the DIB (device under test 
interface board) and handler, and the electrical component focuses on the pin electronics of the 
tester. Both components add to the inaccuracy in the FMAX measurement. The FMAX errors 
are then characterized, and a model is developed using a statistical programming tool. SAS by 
SAS Institute, Inc., a commercially available statistical programming tool, is suitable for such 

20 use, but other programs could be used as well (i.e. MATLAB by Mathworks, Inc., MATHCAD 
by MathSoft, Inc.,etc). 
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System environment characterization involves quantifying those variables that may 
contribute to inaccuracies or anomalies in a product specification (i.e. FMAX) in a system. 
These include such application conditions as compatibility with different components, assessing 
- effects of manufacturing process variation, temperature variation, power supply variation and 
5 noise margin. 

In FIG. 3 the process for obtaining the model for the system environment is illustrated. In 
order to obtain the data for this characterization various system environments are setup at step 21 
for product measurements. A typical setup would include a means of varying system frequency 
(i.e. external oscillator), a means of varying power supply voltage (i.e. voltage regulator), 

10 temperature controller (i.e. Peltier device) and a means of inserting various samples into the same 
board (i.e. a socket). Since not all parts run at their specified voltage/temperature, system power 
supply and temperature are statistically modeled at step 23 using various samples under normal 
operating conditions. These models provide a means of predicting a particular voltage and 
temperature value for any given processor operating at any given time. Next at step 25, the 

15 system is initialized (desired operating temperature, voltage and PLL mode are selected). The 
variable oscillator is then set to a low value and at step 27 the processor is booted at a slow 
frequency. At step 29 the frequency of the oscillator is increased in fixed intervals until the 
system no longer boots. The processor is rebooted at the frequency the system hanged. If the 
system boots, it is exercised using an intensive and comprehensive suite of software packages. If 

20 the processor could not run the complete software suit successfully, the oscillator frequency is 
lowered at step 35 until the processor boots and the software verification testing at step 31 is 
repeated. If the processor booted and ran all software without hanging, the FMAX is recorded at 
step 33. This process is repeated at step 37 for another voltage, temperature, PLL mode or 
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processor. When process is complete, the FMAX data for the system environment are 
characterized at step 39 and included with the tester models. 

Once product FMAX data is collected on a given number of integrated circuits, both on a 
tester and in a system, that data can be analyzed to determine the system-to-tester offset model. 
5 Based on various products studied, in gathering system and tester data best results occur by 
sampling at least 15 to 20 processors per performance sort, generated. At step 50 the system and 
tester FMAX data is input into the statistical software program. At step 52 a system-to-tester 
FMAX delta is calculated. This delta at step 54 is tested for best distribution type (typically, the 
distribution is Gaussian). Based on best distribution fit, at step 58 distribution parameters are 

10 calculated based on sample size and confidence selected at step 60 (for Gaussian distribution, 
population mean and standard deviation are estimated). For a Gaussian distribution, a 
t-distribution is used to estimate population mean and chi-squared distribution is used to estimate 
population standard deviation. These results are output to the Monte Carlo routine at step 62. 
This process is repeated through step 64 for each performance sort or system under analysis 

15 until process is completed at step 66. 

Reliability wearout mechanisms are estimated using both technology models and product 
specific data ( power on hours, use voltage, use temperature, etc.). Depending on the wearout 
mechanism, different parameters will drive guardband. In the case of processor's hot electron 
(hot-e) degradation is an important specification., However, this technique could be extended to 

20 cover other reliability wearout mechanisms (i.e. SER, electromigration, etc.). A hot-e guardband 
model is developed using technology models (design manual equations, circuit models, etc.) and 
product specific variables such as operating voltage, operating temperature and average channel 
length per speed sort. This model predicts performance degradation at end of life. Hot-e is 
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primarily driven by high voltage and short channel length. As illustrated in FIG. 6 fail rates 
increase on axis 15 with frequency (shorter channel lengths) and on axis 13 with voltage. This 
reliability data is characterized by the statistical software program to form a reliability model. 
As illustrated in FIG. 7 the models previously described denoted as blocks 110, 120, and 
5 130 are inputs to the Monte Carlo analysis as well as market sector quality (i.e. SPQL) 
expectations denoted as block 140. Each model is incorporated using the distribution type 
determined during the analysis previously described. A loop value is set (shown as 10,000, in 
block 150 but can be any relatively large number). Each model contributes a value at step 160 
which is randomly selected based on distribution type. One guardband value is determined by 

10 combining the individual values and then adding hot-e input based on performance sort. This is 
repeated through steps 180, 190 and 170 until the loop value selected in block 150 is reached. 
The output is a distribution of guardbands based on all factors previously discussed. Finally, 
depending on market quality expectations input at block 200, a guardband can be selected at 210 
which intelligently satisfies market tolerance expectations while minimizing yield loss (See 

1 5 Figure 2). As can be seen from Fig. 2, trimming a few percent off a guardband , shown as vertical 
axis 4, to make yield targets without understanding the effects on product quality may adversely 
effect product quality. The opposite holds true as well. Over-guardbanding can lead to quality 
levels not required in the market which can in turn adversely affect yields and revenue. 

As mentioned earlier any statistical software program can be used with the invention. 

20 SAS is used in the current implementation, but other programs are just as good (i.e. MATLAB, 
MATHCAD, etc.). One also uses these statistical software programs when determining the 
"critical specification" probability statistics. You also use the statistical software for running the 
Monte Carlo analysis for determining the final guardband. 
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FIG. 8. illustrates the typical hardware configuration of a computer system capable of 
creating the test guardband in accordance with the subject invention. The configuration 
5 comprises at least one processor or central processing unit (CPU) 10. CPU(s) 10 is 

interconnected via system bus 12 to a random access memory (RAM) 14 5 read-only memory 
(ROM) 16, an input/output (I/O) adapter 18 for connecting peripheral devices such as disk units 
20 and tape drives 40 containing a statistical program capable of doing statistical distribution 
analysis to bus 12, user interface adapter 22 for connecting keyboard 24, mouse 26, speaker 28, 

10 microphone 32, and/or other user interface devices such as touch screen device (not shown) to 
bus 12 for inputting data such as tolerance data, communication adapter 34 for connecting the 
information handling system to a data processing network and for inputting various 
environmental models into the computer the models, and display adapter 36 for- connecting bus 
12 to display device 38. The variable inputs shown on FIG. 7 and the SAS software are loaded 

1 5 on the appropriate disk or tape units or fed either through I/O adapters or the network for 
processing. A computer program with an appropriate application interface could be created by 
one of skill in the art and stored on the system to simplify the practicing of this invention. 

Although this disclosure identifies a preferred embodiment, it should be noted this system 
could be easily extended to enable quantifiable business decisions which maximize revenue 

20 while not sacrificing quality when considering variables that affect products or process 

specifications by: implementing other analysis methods, including other variables that affect 
maximizing revenue while balancing risk and also applying this system to other applications 
within and outside the semiconductor industry. 
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Claims 



1. A method for determining a specification guardband comprising the steps of: 

creating a set of distribution models representative of variables that affect said specification; 
5 analyzing the set of models with a statistical tool that can work with the distribution models; and 
selecting a guardband for said specification based on the statistical analysis and a tolerance 
target for the said specification under analysis. 

2. The method of claim 1 where one of the variables is the system on which the product is used. 

10 

3. The method of claim 2 where one of the variables is the system to tester offset. 

4. The method of claim 1 where one of the variables is the test system which the guardband is 
used. 

15 

5. The method of claim 1 where the statistical tool uses a Monte Carlo analysis. 

6. The method of claim 1 where the product specification is maximum frequency. 

20 7. The method of claim 1 where a sample chosen for creating the models is at least 10. 
8. The method of claim 1 where the tolerance target is a quality target. 
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9. The method of claim 1 where the tolerance target is a revenue target. 

10. The method of claim 1 where one of the set of models is a reliability wearout model. 

5 

1 1 . The method of claim 1 where student-t and chi-squared distribution models are used. 

12. The method of claim 2 where the step of creating a set of models includes the additional 
steps of: 

10 setting up the system environment; 

modeling system variables distributions during normal operation; 
setting initial system variables; 

booting the system at increasing frequencies until the system hangs; 

running system applications at the highest frequency at which the system functions and record 
15 such frequency; and 

changing the initial system variables and performing on the new variables the same steps applied 
to the initial system variables. 

20 13. The method of claim 3 where the creating a set of models includes the additional steps of: 
inputting tester to system correlation data; 
calculating system to tester offset for a set of samples; 
choosing an appropriate distribution model for the tester to system offset and 
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calculating a tester to system mean and sigma based on the sample size. 

14. The method of claim 4 where the step of creating a set of models includes the additional 
5 steps of: 

characterizing tester system electrical and mechanical parameters that affect specifications under 
analysis; 

characterizing tester system to tester system offset; 

choosing an appropriate distribution model for said tester system parameters; and 
10 tester system offset. 

15. The method of claim 12 where system variable distributions are power supply voltage and 
operating temperature. 

15 

16. The method of claim 12 where the method of calculating tester to system mean and sigma is 
applied to a different speed sort. 

20 

17. The method of claim 13 where the method of calculating tester to system mean and sigma is 
applied to a different system. 
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18. The method of claim 14 where tester system electrical parameters are tester timing accuracy, 
clock edge placement accuracy and tester power supply distributions. 



19. The method of claim 14 where tester system mechanical parameters are device under test 
interface board, tester temperature and tester handler distributions. 

10 20. A program storage device readable by machine, tangibly embodying a program of 
instructions executable by the machine to perform method steps for determining a tester 
guardband, the method comprising the steps of: 

creating a set of distribution models representative of environmental variables for the tester and 
the product under test, the set of models based on a product parameter variables that affect said 
15 specification; 

analyzing the set of models with a statistical tool that can work with the distribution models; and 
selecting a guardband for the tester said specification based on the statistical analysis and a 
tolerance target for the product under test said specification under analysis 



20 



21 . The program storage device readable by machine, tangibly embodying a program of 



instructions executable by the machine to perform method steps for determining a tester 
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guardband, of claim 20 wherein the program of instruction provides that one of the variables is 
the system on which the product is used. 

22. The program storage device readable by machine, tangibly embodying a program of 
5 instructions executable by the machine to perform method steps for determining a tester 

guardband, of claim 20 wherein the program of instruction provides that one of the variables the 
system to tester offset. 

23. The program storage device readable by machine, tangibly embodying a program of 
10 instructions executable by the machine to perform method steps for determining a tester 

guardband, of claim 20 wherein the program of instruction provides that one of the variables is 
test system where the guardband is used. 

15 24. The program storage device readable by machine, tangibly embodying a program of 
instructions executable by the machine to perform method steps for determining a tester 
guardband, of claim 20 wherein the program of instruction provides that one of the set of models 
is a reliability wearout model. 

20 

25. The program storage device readable by machine, taigibly embodying a program of 
instructions executable by the machine to perform method steps for determining a tester 
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guardband, of claim 20 wherein the program of instruction includes statistical program tool that 
uses a Monte Carlo analysis. 

5 26. The program storage device readable by machine, tangibly embodying a program of 
instructions executable by the machine to perform method steps for determining a tester 
guardband, of claim 20 wherein the program of instruction provides that the models are student-t 
and chi-squared distribution models 

10 

27.. A computer configured for determining a tester guardband, the computer comprising: 
an application interface for inputting various environmental models into the computer the 
models comprising a tester model and system model; 

a memory that contains a statistical program capable of doing statistical distribution analysis; 
1 5 an application interface for inputting tolerance data; 

an execution unit that receives the statistical program and environmental models and processes 
the guardbands based on the tolerance data; and 
an I/O device for outputting the guardband data .. 

20 
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STATISTICAL GUARDBAND METHODOLOGY 



ABSTRACT 

A method for creating a guardband that incorporates statistical models for test 
environment, system environment, tester-to-system offset and reliability into a model and then 
processes a final guardband by factoring manufacturing process variation and qualityagainst 
yield loss. 
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